Application execution apparatus and application execution method

ABSTRACT

An object of the present invention is to provide an application execution apparatus and an application execution method which enable quick startup at cold boot, and which can prevent occurrence of flicker in a display image at the time of camera image handover. The application execution apparatus according to the present invention includes a kernel that includes a predetermined function mechanism, a framework that is started by the kernel, and that includes an abstracted function mechanism obtained by abstracting the function mechanism, a first application that operates by directly using the function mechanism, and a second application that operates by indirectly using the function mechanism through the abstracted function mechanism, and that includes a function of the first application, where a volume of the first application is smaller than a volume of the second application.

TECHNICAL FIELD

The present invention relates to an application execution apparatus andan application execution method for executing an application.

BACKGROUND ART

There is a technique of mounting, on a vehicle, a camera for capturingthe back side, and of displaying a video (hereinafter referred to as acamera image) captured by the camera on a display at the time ofbackward start. The technique requires the camera image to be quicklydisplayed on the display at the time of backward start.

For example, a camera image processed by hardware other than a CentralProcessing Unit (CPU) having a sophisticated Operating System (OS) isoutput to a display, or a camera image is output to the display by aboot loader function of the CPU having the sophisticated OS, and then, acamera image is output to the display after superimposition of a guideline by the hardware other than the CPU or a camera application of thesophisticated OS. In this manner, video handover of displaying a cameraimage first, and then, displaying a camera image on which a guide lineis superimposed is performed. Here, a sophisticated OS is an OS thatperforms high-level information processing, and a Linux (registeredtrademark) OS, an AndroidOS and the like may be cited, for example.

Conventionally, there is disclosed an on-vehicle rear monitoring deviceincluding a camera installed at a rear portion of a vehicle, an imageprocessing circuit for processing a video signal and for outputting thesignal to image display means, and determination means for determiningwhether processing (process of superimposing a guide line on an image)can be performed by the image processing circuit in coordination with aninput operation of reverse gear, where a process of superimposing aguide line on a camera image is not performed in a case where a guideline is not necessary, and a process of superimposing a guide line on acamera image is performed in a case where a guide line is necessary (forexample, see Patent Document 1).

There is also disclosed a display device for a vehicle, the displaydevice including startup determination means for determining whetherstartup of a main CPU is completed or not, and display control means forcausing, in a case where the startup determination means determines thatstartup of the main CPU is not completed, an image obtained by an imagepickup device by a display CPU, without using the main CPU, to bedisplayed on an on-vehicle display appliance (for example, see PatentDocument 2).

Furthermore, there is disclosed an electronic appliance including afirst instruction unit for issuing an instruction for normal startup ofthe electronic appliance, a second instruction unit for issuing aninstruction for temporary startup of the electronic appliance, a firstarithmetic processing unit, and a second arithmetic processing unit,where, in a case where an instruction is issued by the first instructionunit, the first arithmetic processing unit executes a first operatingsystem, and executes processing of a first user interface when startupof the first operating system is completed, and in a case where aninstruction is issued by the second instruction unit, the firstarithmetic processing unit does not execute the first operating systemor the first user interface, and where the second arithmetic processingunit executes a second operating system that is started in a shortertime than the first operating system, and in a case where an instructionis issued by the first instruction unit, the second arithmeticprocessing unit executes processing of a second user interface whenstartup of the second operating system is completed, and suppressesexecution of processing of the second user interface when startup of thefirst operating system is completed (for example, see Patent Document3).

PRIOR ART DOCUMENTS Patent Documents

Patent Document 1: Japanese Patent No. 4498771 (B2)

Patent Document 2: Japanese Patent No. 4978558 (B2)

Patent Document 3: Japanese Patent No. 5028904 (B2)

SUMMARY OF INVENTION Problems to be Solved by the Invention

As described above, when displaying a camera image on a display at thetime of a vehicle starting backwards, the camera image is required to bequickly displayed on the display (for example, within two seconds ofturning on of power). That is, to start an application for displaying acamera image (hereinafter referred to as a camera application) as fastas possible becomes an important issue. Particularly, startup at coldboot takes time, and startup at cold boot has to be made fast.

In Patent Document 1, whether processing by a graphic LSI is possiblewhen the reverse gear is ON is determined, and if processing by thegraphic LSI is determined to be not possible, switching is performed byswitching means to achieve a state where a video signal of a camera isdirectly input to an LCD panel without using the graphic LSI.Accordingly, hardware for superimposing a guide line on a camera imageis necessary, resulting in an increase in the cost. Also, because thepassing route of a camera image is switched by the switching means,flicker is caused in a display image at the time of camera imagehandover.

In Patent Document 2, because switching is performed between the mainCPU and the display CPU, passing routes of camera images are different.Accordingly, flicker is caused in a display image at the time of cameraimage handover. Also, hardware for superimposing a guide line on acamera image is necessary, resulting in an increase in the cost.

In Patent Document 3, switching is performed between the first operatingsystem and the second operating system, and thus, flicker is caused in adisplay image at the time of switching (at the time of camera imagehandover).

In the case of outputting a camera image to a display by a boot loaderfunction of a CPU having a sophisticated OS, flicker is caused in adisplay image at the time of camera image handover.

As described above, conventionally, there is a problem that flicker iscaused in a display image at the time of camera image handover.Therefore, startup is desirably performed at a high speed at cold boot,and occurrence of flicker in a display image at the time of camera imagehandover is desirably prevented.

The present invention has been made to solve the problems as describedabove, and has its object to provide an application execution apparatusand an application execution method which enable quick startup at coldboot, and which can prevent occurrence of flicker in a display image atthe time of camera image handover.

Means for Solving the Problems

To solve the problems described above, an application executionapparatus according to the present invention includes a kernel thatincludes a predetermined function mechanism, a framework that is startedby the kernel, and that includes an abstracted function mechanismobtained by abstracting the function mechanism, a first application thatoperates by directly using the function mechanism, and a secondapplication that operates by indirectly using the function mechanismthrough the abstracted function mechanism, and that includes a functionof the first application, where a volume of the first application issmaller than a volume of the second application.

Also, an application execution method according to the present inventionis an application execution method for sequentially starting at least akernel and a framework and for executing a first application and asecond application, where the kernel includes a predetermined functionmechanism, where the framework is started by the kernel, and includes anabstracted function mechanism obtained by abstracting the functionmechanism, where the first application operates by directly using thefunction mechanism, where the second application operates by indirectlyusing the function mechanism through the abstracted function mechanism,and includes a function of the first application, and where a volume ofthe first application is smaller than a volume of the secondapplication.

Effects of the Invention

According to the present invention, the application execution apparatusincludes a kernel that includes a predetermined function mechanism, aframework that is started by the kernel, and that includes an abstractedfunction mechanism obtained by abstracting the function mechanism, afirst application that operates by directly using the functionmechanism, and a second application that operates by indirectly usingthe function mechanism through the abstracted function mechanism, andthat includes a function of the first application, and a volume of thefirst application is smaller than a volume of the second application,and thus, quick startup can be performed at cold boot, and also,occurrence of flicker in a display image can be prevented at the time ofcamera image handover.

Also, the application execution method is an application executionmethod for sequentially starting at least a kernel and a framework andfor executing a first application and a second application, where thekernel includes a predetermined function mechanism, where the frameworkis started by the kernel, and includes an abstracted function mechanismobtained by abstracting the function mechanism, where the firstapplication operates by directly using the function mechanism, where thesecond application operates by indirectly using the function mechanismthrough the abstracted function mechanism, and includes a function ofthe first application, and where a volume of the first application issmaller than a volume of the second application, and thus, quick startupcan be performed at cold boot, and also, occurrence of flicker in adisplay image can be prevented at the time of camera image handover.

The objects, features, aspects and advantages of the present inventionwill be made more apparent by the following detailed description and theappended drawings.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram showing an example of a hardware configurationof an application execution apparatus according to a first embodiment ofthe present invention.

FIG. 2 is a block diagram showing an example of a software configurationof the application execution apparatus according to the first embodimentof the present invention.

FIG. 3 is a block diagram showing an example of the softwareconfiguration of the application execution apparatus according to thefirst embodiment of the present invention.

FIG. 4 is a block diagram showing an example of the hardwareconfiguration of the application execution apparatus according to thefirst embodiment of the present invention.

FIG. 5 is a diagram showing an example of an order of startup of theapplication execution apparatus according to the first embodiment of thepresent invention.

FIG. 6 is a diagram showing an example of operation of the applicationexecution apparatus according to the first embodiment of the presentinvention.

FIG. 7 is a diagram showing an example of the operation of theapplication execution apparatus according to the first embodiment of thepresent invention.

FIG. 8 is a diagram showing an example of the operation of theapplication execution apparatus according to the first embodiment of thepresent invention.

FIG. 9 is a diagram showing an example of the operation of theapplication execution apparatus according to the first embodiment of thepresent invention.

FIG. 10 is a diagram showing an example of the operation of theapplication execution apparatus according to the first embodiment of thepresent invention.

FIG. 11 is a diagram showing an example of operation of an applicationexecution apparatus according to a second embodiment of the presentinvention.

FIG. 12 is a diagram showing an example of the operation of theapplication execution apparatus according to the second embodiment ofthe present invention.

FIG. 13 is a block diagram showing an example of a softwareconfiguration of an application execution apparatus according to a thirdembodiment of the present invention.

FIG. 14 is a block diagram showing an example of the softwareconfiguration of the application execution apparatus according to thethird embodiment of the present invention.

FIG. 15 is a diagram showing a relationship between a frame controlmechanism and a display mechanism according to the third embodiment ofthe present invention.

FIG. 16 is a diagram showing an example of operation of the applicationexecution apparatus according to the third embodiment of the presentinvention.

FIG. 17 is a diagram showing an example of the operation of theapplication execution apparatus according to the third embodiment of thepresent invention.

FIG. 18 is a diagram showing an example of the operation of theapplication execution apparatus according to the third embodiment of thepresent invention.

FIG. 19 is a diagram showing an example of the operation of theapplication execution apparatus according to the third embodiment of thepresent invention.

FIG. 20 is a diagram showing an example of a case where only aconventional normal camera application is operated.

FIG. 21 is a block diagram showing an example of a hardwareconfiguration according to a conventional technique.

FIG. 22 is a block diagram showing an example of a softwareconfiguration according to a conventional technique.

DESCRIPTION OF EMBODIMENTS

Embodiments of the present invention will be described below withreference to the drawings.

First Embodiment

First, a configuration of an application execution apparatus accordingto a first embodiment of the present invention will be described.

FIG. 1 is a block diagram showing an example of a hardware configurationof the application execution apparatus according to the firstembodiment. Additionally, FIG. 1 shows an example of a hardwareconfiguration of an application execution apparatus which executes anapplication for causing a camera image captured by a camera 1 to bedisplayed on a display 4.

As shown in FIG. 1, a camera image captured by the camera 1 is convertedby a capture 2 into a format suitable for a CPU 3. The camera imageconverted by the capture 2 is output to the display 4 after addition ofdrawing information such as a guide line by the CPU 3. The CPU 3switches between a camera image and a camera image to which drawinginformation such as a guide line is added. The application executionapparatus according to the first embodiment is realized by operation ofthe CPU 3.

The hardware configuration shown in FIG. 1 is the same as a hardwareconfiguration for outputting a normal camera image to a display(hardware configuration not requiring quick startup), and does notinclude separate hardware for performing quick startup. In the firstembodiment, quick startup is realized by the hardware configurationshown in FIG. 1.

FIG. 21 is a block diagram showing an example of a hardwareconfiguration according to a conventional technique. Additionally, FIG.21 schematically shows a hardware configuration according to PatentDocuments 1 and 2.

As shown in FIG. 21, before a CPU 28 is started, a camera image capturedby a camera 25 is output to a display 30 through a path of a capture 26,a graphic 27, a switch 29 and the display 30. At this time, a cameraimage captured by the camera 25 is displayed on the display 30.

Furthermore, when the CPU 28 is started, a camera image captured by thecamera 25 is output to the display 30 through a path of the capture 26,the graphic 27, the CPU 28 and the switch 29. At this time, a cameraimage subjected to a guide line superimposition process by the CPU 28 isdisplayed on the display 30.

As described above, according to the conventional technique shown inFIG. 21, the passing path of a camera image is switched by the switch29, and thus, flicker is caused at the time of camera image handover.

FIG. 2 is a block diagram showing an example of a software configurationof the application execution apparatus according to the firstembodiment. Additionally, FIG. 2 shows a software configurationperformed by the CPU 3 in FIG. 1.

As shown in FIG. 2, the CPU 3 has functions of executing a kernel 5, aframework 7, a native camera application 9, and a normal cameraapplication 10.

The kernel 5 includes a display mechanism 6, which is a function forperforming display on the display 4. Also, the kernel 5 includes adriver for performing display on the display 4 (in the example in FIG.2, a display driver and a capture driver), and a hardware resource (inthe example in FIG. 2, a device which is provided to the CPU 3 and whichis connected to the display 4). The display mechanism 6 is at an upperlevel of the driver. Additionally, the first embodiment describes thekernel 5 to be a Linux kernel, but this is not restrictive. Also, thedisplay mechanism 6 may be SurfaceFlinger and Hardware Composer ofAndroidOS.

The framework 7 includes an abstracted display mechanism 8 obtained byabstracting the display mechanism 6, the driver, and the hardwareresource provided to the kernel.

The native camera application 9 is an application for displaying acamera image on the display 4, and operates by directly using thedisplay mechanism 6. Moreover, the native camera application 9 includesonly a basic function of outputting or not outputting a camera image,and does not include a function for superimposing a guide line on acamera image. That is, the native camera application 9 includes aspecific function among functions of the normal application 10 describedlater.

The normal camera application 10 is an application for displaying acamera image on the display 4, and operates by indirectly using thedisplay mechanism 6 through the abstracted display mechanism 8.Moreover, the normal camera application 10 includes a complex functionsuch a function for superimposing a guide line on a camera image.

FIG. 3 is a block diagram showing an example of the softwareconfiguration of the application execution apparatus according to thefirst embodiment. Additionally, the software configuration shown in FIG.3 is the software configuration shown in FIG. 2 after generalization.

As shown in FIG. 3, the kernel 5 includes a function mechanism 11including the display mechanism 6 in FIG. 2. Also, the kernel 5 includesdrivers and hardware resources in a peripheral group, including thedriver and the hardware resource described with reference to FIG. 2.

The framework 7 includes an abstracted function mechanism 12 obtained byabstracting the function mechanism 11, the driver, and the hardwareresource.

A native application 13 (first application) operates by directly usingthe function mechanism 11. Also, a normal application 14 (secondapplication) has the function of the native application 13, and operatesby indirectly using the function mechanism 11 through the abstractedfunction mechanism 12. The native application 13 includes a specificfunction among functions of the normal application 14.

FIG. 22 is a block diagram showing an example of a softwareconfiguration according to a conventional technique. Additionally, FIG.22 schematically shows a software configuration according to PatentDocuments 3.

As shown in FIG. 22, an OS 31 includes a display mechanism 32, and anapplication 33 operates by using the display mechanism 32. Also, an OS34 includes a display mechanism 35, and an application 36 operates byusing the display mechanism 35. Additionally, the applications 33, 36are applications for causing a video to be displayed on a display.

According to the conventional technique shown in FIG. 22, because the OS31, 34 is different for each application 33, 36, the OS 31, 34 has to beswitched at the time of switching the application 33, 36. At this time,because the display mechanism 32, 35 is different for each application33, 36, flicker is caused in the video at the time of switching of theapplication 33, 36.

FIG. 4 is block diagram showing an example of the hardware configurationof the application execution apparatus according to the firstembodiment. Additionally, FIG. 4 shows a hardware configuration of theCPU 3 in FIG. 1 and its periphery.

As shown in FIG. 4, a NOR flash memory 15, an embedded Multi Media Card(eMMC) 16, and a Dynamic Random Access Memory (DRAM) 17 are connected tothe CPU 3. Additionally, the NOR flash memory 15, the eMMC 16, and theDRAM 17 are omitted in FIG. 1.

The NOR flash memory 15 stores a boot loader 18. Additionally, it issufficient if the NOR flash memory 15 is a small capacity storage, andthe NOR flash memory 15 may be a Read Only Memory (ROM) or the like, forexample.

The eMMC 16 stores the kernel 5, the framework 7, and applications (notshown) including the native camera application 9 and the normal cameraapplication 10. Additionally, it is sufficient if the eMMC 16 is a largecapacity storage, and the eMMC 16 may be a hard disk or the like, forexample.

The CPU 3 loads at least one of the kernel 5, the framework 7, and theboot loader 18 into the DRAM 17 to be operated. Additionally, the nativecamera application 9 and the normal camera application 10 in FIG. 2, andthe native application 13 and the normal application 14 in FIG. 3 arestored in the eMMC 16.

Next, overall operation of the application execution apparatus will bedescribed with reference to FIGS. 5 to 8.

As shown in FIG. 5, the application execution apparatus operates bysequentially starting the boot loader 18, the kernel 5, and theframework 7. In the following, details of start of the boot loader 18,the kernel 5, and the framework 7 will be given.

As shown in FIG. 6, the CPU 3 loads the boot loader 18 stored in the NORflash memory 15 into the DRAM 17 by using a program stored in the NORflash memory 15. The loaded boot loader 18 operates by starting at theDRAM 17. Here, the program stored in the NOR flash memory 15 has afunction for loading the boot loader 18 into the DRAM 17.

As shown in FIG. 7, the boot loader 18 loads the kernel 5 stored in theeMMC 16 into the DRAM 17. The loaded kernel 5 operates by starting atthe DRAM 17. More specifically, the kernel 5 initializes and developsthe driver, the hardware resource, and the function mechanism.

As shown in FIG. 8, the kernel 5 loads the framework 7 stored in theeMMC 16 into the DRAM 17. The loaded framework 7 operates by starting atthe DRAM 17. More specifically, the framework 7 initializes and developsthe abstracted function mechanism and other software components (otherabstracted function mechanisms).

In the above description, the sophisticated OS is configured by theframework 7. The kernel 5 and the framework 7 cooperatively operate atthe DRAM 17. On the other hand, when loading of the sophisticated OS iscompleted, the boot loader 18 is discharged from the DRAM 17 and doesnot operate. The boot loader 18 and the sophisticated OS are ofdifferent systems. Additionally, the first embodiment describes thesophisticated OS (framework 7) to be AndroidOS, but this is notrestrictive.

Next, the operation of the application execution apparatus will bedescribed in detail.

FIG. 9 is a diagram showing an example of the operation of theapplication execution apparatus, where the CPU 3 includes each functionshown in FIG. 3.

As shown in FIG. 9, after the power of the CPU 3 is turned on, the bootloader 18 loads the kernel 5 into the DRAM 17. The kernel 5 starts atthe DRAM 17 (see FIGS. 6, 7).

The CPU 3 loads the native application 13 into the DRAM 17, and startsthe native application 13. The native application 13 performs apredetermined function by directly using the function mechanism 11 ofthe kernel 5.

After the native application 13 is started, the kernel 5 loads theframework 7 into the DRAM 17. The framework 7 starts at the DRAM 17 (seeFIG. 8).

After the framework 7 is started, the CPU 3 loads the normal application14 into the DRAM 17, and starts the normal application 14. The normalapplication 14 performs a predetermined function by indirectly using thefunction mechanism 11 of the kernel 5 through the abstracted functionmechanism 12 of the framework 7.

In the above description, the native application 13 is loaded into theDRAM 17 and is developed, and thus, the loading time is dependent on thevolume of the native application 13. To start the native application 13in a short time after turning on of the CPU 3, the function of thenative application 13 has to be minimized and the program volume of thenative application 13 has to be suppressed (that is, the volume of thenative camera application 9 has to be made smaller than that of thenormal camera application 10). This optimizes the loading time of thenative application 13, and the time from turning on of the CPU 3 tooperation of the native application 13 is reduced.

Additionally, operation of the native application 13 is ended at anarbitrary timing after execution of the normal application 14. Thearbitrary timing may be the time of start of operation of the normalapplication 14, or the time when the normal application 14 hascompletely operated (after operation of the normal application 14), forexample.

FIG. 10 is a diagram showing an example of the operation of theapplication execution apparatus, where the CPU 3 includes each functionshown in FIG. 2.

As shown in FIG. 10, after the power of the CPU 3 is turned on, the bootloader 18 loads the kernel 5 into the DRAM 17. The kernel 5 starts atthe DRAM 17 (see FIGS. 6, 7).

The CPU 3 loads the native camera application 9 into the DRAM 17, andstarts the native camera application 9. The native camera application 9outputs a camera image to the display 4 by using the display mechanism 6of the kernel 5.

After the native camera application 9 is started, the kernel 5 loads theframework 7 into the DRAM 17. The framework 7 starts at the DRAM 17 (seeFIG. 8).

After the framework 7 is started, the CPU 3 loads the normal cameraapplication 10 into the DRAM 17, and starts the normal cameraapplication 10. The normal camera application 10 displays, on thedisplay 4, a camera image on which additional information such as aguide line is superimposed, by indirectly using the display mechanism 6of the kernel 5 through the abstracted display mechanism 8 of theframework 7.

In the above description, the native camera application 9 is loaded intothe DRAM 17 and is developed, and thus, the loading time is dependent onthe volume of the native camera application 9. To start the nativecamera application 9 in a short time after turning on of the CPU 3, thefunction of the native camera application 9 has to be minimized and theprogram volume of the native camera application 9 has to be suppressed(that is, the volume of the native camera application 9 has to be madesmaller than that of the normal camera application 10). This optimizesthe loading time of the native camera application 9, and the time fromturning on of the CPU 3 to operation of the native camera application 9is reduced.

Also, the native camera application 9 and the normal camera application10 operate by directly or indirectly using the same display mechanism 6.Accordingly, flicker in a display screen is not caused at the time ofswitching from a camera image by the native camera application 9 to acamera image by the normal camera application 10.

Additionally, operation of the native camera application 9 is ended atan arbitrary timing after execution of the normal camera application 10.The arbitrary timing may be the time of start of operation of the normalcamera application 10, or the time when the normal camera application 10has completely operated (after operation of the normal cameraapplication 10), for example.

As described above, according to the first embodiment, quick startup atcold boot may be realized by minimizing the function of the nativeapplication 13 (or of the native camera application 9). Also, becausethe native camera application 9 and the normal camera application 10 usethe same function mechanism 11 (or the display mechanism 6), occurrenceof flicker in the display image may be prevented at the time of cameraimage handover.

Second Embodiment

According to the first embodiment, the entire function mechanism 11 inthe kernel 5 has to be started to cause the entire abstracted functionmechanism 12 in the framework 7 to operate. Accordingly, the kernel 5has to initialize and develop all the drivers, all the hardwareresources, and all the function mechanisms, andinitialization/development by the kernel takes time (see FIG. 9).

According to a second embodiment of the present invention, functionmechanisms and the like necessary for operation of the nativeapplication are started in advance. Other configurations and operationsare the same as those in the first embodiment, and detailed descriptionthereof is omitted.

FIG. 11 is a diagram showing an example of the operation of theapplication execution apparatus, where the CPU 3 includes each functionshown in FIG. 3.

As shown in FIG. 11, after the power of the CPU 3 is turned on, the bootloader 18 loads the kernel 5 into the DRAM 17. The kernel 5 starts atthe DRAM 17 (see FIGS. 6, 7). At this time, the kernel 5 initializes anddevelops a driver, a hardware resource, and a function mechanismrequired by the native application 13, among the function mechanism 11.

The CPU 3 loads the native application 13 into the DRAM 17, and startsthe native application 13. The native application 13 performs apredetermined function by directly using a function mechanism requiredby the native application 13, among the function mechanism 11 of thekernel 5.

After the native application 13 is executed, the kernel 5 initializesand develops a driver, a hardware resource, and a function mechanism notrequired by the native application 13, among the function mechanism 11.

The following operation (such as startup of the normal application 14)is the same as that of the first embodiment (see FIG. 9), anddescription thereof is omitted.

The time from turning on of the CPU 3 to operation of the nativeapplication 13 may thus be reduced.

FIG. 12 is a diagram showing an example of the operation of theapplication execution apparatus, where the CPU 3 includes each functionshown in FIG. 2.

As shown in FIG. 12, after the power of the CPU 3 is turned on, the bootloader 18 loads the kernel 5 into the DRAM 17. The kernel 5 starts atthe DRAM 17 (see FIGS. 6, 7). At this time, the kernel 5 initializes anddevelops a driver, a hardware resource, and the display mechanism 6required by the native camera application 9, among the functionmechanism 11.

The CPU 3 loads the native camera application 9 into the DRAM 17, andstarts the native camera application 9. The native camera application 9outputs a camera image to the display 4 by directly using the displaymechanism 6 of the kernel 5.

After the native camera application 9 is executed, the kernel 5initializes and develops a driver, a hardware resource, and a functionmechanism (function mechanism other than the display mechanism 6) notrequired by the native camera application 9, among the functionmechanism 11.

The following operation (such as startup of the normal cameraapplication 10) is the same as that of the first embodiment (see FIG.10), and description thereof is omitted.

The time from turning on of the CPU 3 to operation of the native cameraapplication 9 may thus be reduced.

As described above, according to the second embodiment, quick startup atcold boot may be realized by starting a function mechanism required bythe native application 13 (or the native camera application 9) inadvance, and then executing the native application 13 (or the nativecamera application 9).

Additionally, as in the first embodiment, the volume of the nativeapplication 13 (or the native camera application 9) may be smaller thanthat of the normal application 14 (or the normal camera application 10).

Third Embodiment

FIGS. 13 and 14 are block diagrams showing an example of a softwareconfiguration of an application execution apparatus according to a thirdembodiment of the present invention. Additionally, FIG. 13 shows anentire configuration of the application execution apparatus, and FIG. 14mainly shows a detailed configuration of the kernel 5. Otherconfigurations and operations are the same as those in the firstembodiment, and detailed description thereof is omitted. Additionally,FIG. 13 shows the configuration in FIG. 2 provided with a frame controlmechanism 19, but the frame control mechanism 19 may alternatively beprovided to the configuration in FIG. 3.

As shown in FIG. 13, the application execution apparatus according tothe third embodiment includes the frame control mechanism 19.

As shown in FIG. 14, the display mechanism 6 includes window frames20-22, and a mixer 23. Also, the kernel 5 includes a display driver 24.

The frame control mechanism 19 is one of native applications, and isabstracted window frames 20-22. The frame control mechanism 19 performscontrol of assigning one of the window frames 20-22 to each of a nativeapplication and a normal application.

Each of the window frames 20-22 is a region which stores a drawingwindow and a layer in the drawing window, and which is a screen designconfigured by a native application and a normal application.Additionally, the third embodiment describes a case where the displaymechanism 6 includes three window frames, but it is sufficient if thereare a plurality of window frames, without being limited to three.

The mixer 23 includes a function for superimposing a plurality ofapplications.

The display driver 24 includes a function for outputting a camera imageto the display 4.

FIG. 15 is a diagram showing a relationship between the frame controlmechanism 19 and the display mechanism 6.

The frame control mechanism 19 manages and controls access by a nativeapplication or the abstracted display mechanism 8 of the framework 7 toan arbitrary window frame of the display mechanism 6. That is, the useof a specific window frame can be managed and controlled by the framecontrol mechanism 19.

Next, operation of the application execution apparatus according to thethird embodiment will be described with reference to FIGS. 16 to 18.Additionally, in the following, a case where the application executionapparatus has the configuration shown in FIG. 13 will be described.

FIG. 16 shows a case of operation of the native camera application 9. Asshown in FIG. 16, the frame control mechanism 19 assigns the windowframe 20 of the display mechanism 6 to the native camera application 9.When the native camera application 9 operates, a camera image passesthrough the window frame 20 and the mixer 23 and is output to thedisplay 4 by driving of the display driver 24 of the kernel 5. At thistime, the native camera application 9 does not have to grasp whichwindow frame of the display mechanism 6 is being used.

FIG. 17 shows a case of operation of an arbitrary normal application(other than the normal camera application 10) not including the functionfor outputting a camera image to the display 4. As shown in FIG. 17, theframe control mechanism 19 assigns the window frame 22 of the displaymechanism 6 to the abstracted display mechanism 8 of the framework 7.When a normal application operates, an image drawn by the normalapplication passes through the window frame 22 and the mixer 23 and isoutput to the display 4 by driving of the display driver 24 of thekernel 5. At this time, the abstracted display mechanism 8 of theframework 7 does not have to grasp which window frame of the displaymechanism 6 is being used.

In the case of simultaneous execution of FIGS. 16 and 17, a camera imageby the operation of the native camera application 9 is input to thewindow frame 20, and an image by the operation of an arbitrary normalapplication, other than the normal camera application 10, is input tothe window frame 22.

The mixer 23 of the display mechanism 6 outputs only the camera image bythe operation of the native camera application 9 to the display 4, oroutputs only the image by the operation of the arbitrary normalapplication to the display 4, or performs output to the display 4 aftersuperimposing the camera image by the operation of the native cameraapplication 9 with the image by the operation of the arbitrary normalapplication. In this manner, a camera image by the operation of thenative camera application 9 and an image by the operation of anarbitrary normal application may be output by being switched from eachother or by being superimposed with each other.

FIG. 18 shows a case of operation of the normal camera application 10.As shown in FIG. 18, the frame control mechanism 19 assigns the windowframe 20 of the display mechanism 6 to the normal camera application 10through the abstracted display mechanism 8 of the framework 7. When thenormal camera application 10 operates, a camera image passes through thewindow frame 20 and the mixer 23, and is output to the display 4 bydriving of the display driver 24 of the kernel 5.

As described above, the frame control mechanism 19 controls the windowframes according to hardware resources, with no respect to the nativecamera application 9 and the normal camera application 10 at upperlevels of the frame control mechanism 19. In the examples in FIGS. 16and 18, the camera image, which is the hardware resource, is commonbetween the native camera application 9 and the normal cameraapplication 10, and thus, the same window frame 20 is assigned.

As described in the first embodiment (see FIG. 10), at the time ofswitching from the native camera application 9 to the normal cameraapplication 10 (at the time of camera image handover), output of thecamera image is continued by using the window frame 20 under the controlof the frame control mechanism 19, and thus, flicker in the displayimage (disturbance in the camera image) at the time of switching is notcaused.

FIG. 19 is a sequence diagram collectively showing operations shown inFIGS. 16 and 18.

As shown in FIG. 19, when the kernel 5 is started, the display driver24, the display mechanism 6, and the frame control mechanism 19 performinitialization processes. The frame control mechanism 19 acquires awindow list from the display mechanism 6 during the initializationprocess.

When the initialization process of the frame control mechanism 19 iscompleted, the native camera application 9 acquires window informationfrom the frame control mechanism 19, and then, obtains a window 1. Atthis time, the display mechanism 6 obtains a frame buffer from a memory.A camera image is thus captured by the operation of the native cameraapplication 9. Additionally, in the example in FIG. 16, the window 1corresponds to the window frame 20. Also, the memory corresponds to theDRAM 17 in FIG. 4, for example. Moreover, the camera image is capturedby the capture 2 in FIG. 1, for example.

When the kernel 5 is placed in an operation state, the abstracteddisplay mechanism 8 acquires the window information from the framecontrol mechanism 19 during the initialization process. When theinitialization process of the abstracted display mechanism 8 iscompleted, the normal camera application 10 acquires the windowinformation from the abstracted display mechanism 8, and then, issues astop request to the native camera application 9. Then, the normal cameraapplication 10 obtains the window 1 from the abstracted displaymechanism 8.

The normal camera application 10 obtains a window 2 from the displaymechanism 6, and performs drawing of a guide line or the like by usingthe window 2. Additionally, the window 2 may be the window frame 22 (seeFIG. 17), for example.

Switching from the native camera application 9 to the normal cameraapplication 10 is performed in the above manner (that is, camera imagehandover is performed). At this time, because the native cameraapplication 9 and the normal camera application 10 use the common window1, flicker is not caused in the camera image.

FIG. 20 is a diagram showing an example of a case where only aconventional normal camera application is operated. As shown in FIG. 20,the normal camera application does not perform camera image handover byusing a common window with the native camera application as shown inFIG. 19. Accordingly, flicker is conventionally caused at the time ofhandover to a camera image by the operation of the normal cameraapplication.

As described above, according to the third embodiment, occurrence offlicker in a display image at the time of camera image handover may beprevented by assigning the same window frame to the native cameraapplication 9 and the normal camera application 10.

Additionally, as in the first embodiment, the volume of the nativecamera application 9 may be smaller than that of the normal cameraapplication 10.

Also, as in the second embodiment, the native camera application 9 maybe executed by starting a function mechanism (display mechanism 6)required by the native camera application 9 in advance.

Additionally, the embodiments may be freely combined, or an embodimentmay be modified or omitted as appropriate within the scope of thepresent invention.

Although the present invention is described above in detail, thedescription given above is only exemplary in every aspect, and thepresent invention is not limited thereto. It is to be understood that anindefinite number of example modifications not illustrated areconceivable within the scope of the present invention.

REFERENCE SIGNS LIST

1: camera

2: capture

3: CPU

4: display

5: kernel

6: display mechanism

7: framework

8: abstracted display mechanism

9: native camera application

10: normal camera application

11: function mechanism

12 abstracted function mechanism

13: native application

14: normal application

15: NOR flash memory

16: eMMC

17: DRAM

18: boot loader

19: frame control mechanism

20, 21, 22: window frame

23: mixer

24: display driver

25: camera

26: capture

27: graphic

28: CPU

29: switch

30: display

31: OS

32: display mechanism

33: application

34: OS

35: display mechanism

36: application

1. An application execution apparatus comprising: a processor to executeprograms; and a memory to store said programs which, when executed bythe processor, performs said programs of, a kernel that includes apredetermined function mechanism; a framework that is started by saidkernel, and that includes an abstracted function mechanism obtained byabstracting said function mechanism; a first application that operatesby directly using said function mechanism; and a second application thatoperates by indirectly using said function mechanism through saidabstracted function mechanism, and that includes a function of saidfirst application, wherein a volume of said first application is smallerthan a volume of said second application.
 2. (canceled)
 3. Theapplication execution apparatus according to claim 1, wherein saidfunction mechanism includes a display mechanism.
 4. The applicationexecution apparatus according to claim 3, further comprising a framecontrol mechanism that controls a plurality of window frames included insaid display mechanism, wherein said frame control mechanism performscontrol such that same said window frame is assigned at a time ofoperation of each of said first application and said second application.5. The application execution apparatus according to claim 1, whereinoperation of said first application is ended after execution of saidsecond application.
 6. The application execution apparatus according toclaim 1, wherein said kernel is a Linux (registered trademark) kernel.7. The application execution apparatus according to claim 1, whereinsaid framework is Android (registered trademark) OS.
 8. The applicationexecution apparatus according to claim 3, wherein said display mechanismis SurfaceFlinger and Hardware Composer of Android (registeredtrademark) OS.
 9. An application execution method for sequentiallystarting at least a kernel and a framework and for executing a firstapplication and a second application, wherein said kernel includes apredetermined function mechanism, wherein said framework is started bysaid kernel, and includes an abstracted function mechanism obtained byabstracting said function mechanism, wherein said first applicationoperates by directly using said function mechanism, wherein said secondapplication operates by indirectly using said function mechanism throughsaid abstracted function mechanism, and includes a function of saidfirst application, and wherein a volume of said first application issmaller than a volume of said second application.